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(57) ABSTRACT 

A data processing apparatus configured as a browser (70) is 
described for use with a distributed database management 
utility (72) which handles the accessing of data defining 
virtual environments via the Internet/World Wide Web (74). 
Both browser (70) and management utility (72) maintain 
copies of data files obtained via the Web and passed to the 
browser, with a memory management stage (80) detecting 
when apparatus jnemory reaches a predetermined level o f 
fullness. Based on a stored and system-updated table (84) 
identifying the passing of data files from management utility 
to browser, the memory manager (80) identifies which of the 
management utility held copies of the files to delete in order 
to create memory space. 

8 Claims, 3 Drawing Sheets 
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DISTRIBUTED DATABASE ACCESS VIA a location and with an orientation in said virtual environ- 

VIRTUAL ENVIRONMENT BROWSER ment determined at least partially by input from said user 

input means; characterized in that further storage means are 

BACKGROUND OF THE INVENTION provided with the apparatus further comprising memory 

The present invention relates to apparatus for accessing, ^ management means configured to place in said further 

from a remote source, data defining a graphical representa- storage means a copy of each data file received via the 

tion of a virtual environment, with the user being enabled to network, to check within said further storage means for data 

select one from a plurality of available virtual environments before calling for them via the network, and to deter- 

and the apparatus having means for rendering a display of t»oth required and available data storage capacity for at 

the selected virtual environment from one or more view- least the first and further storage means of the apparatus and, 

points when the requi red ca£ acit y exceeds_a predetermined level, to 

Adescription of a service providing a virtual enviromnent 3lear„f rom sddlS^^ data:file3 .also 

(or cyber-space) accessible by remote users is given in P^^se^i^ Ji_e first stgragemeans. 

European patent application EP-A-0 697 613 (Sony Corp.). Since accesses to remotely-stored virtual environments 

The system described includes a server providing a virtual will typically involve downloading of a number of related 

reality space, and user terminals connected to the server via data files (for example texture files for all surfaces which 

a high-speed communications network (using optical fibers "i^y be encountered within the virtual environment) and not 

or the like). In operation, the server maintains a number of all such files will be required at any given lime, by providing 

virtual environments and supports many differing terminal the further memory (which may be a partitioned area of the 

types by the use of conversion objects between information '^^ ^^^0 to l^old copies of received files, access times may be 

objects and user objects: the conversion objects provide reduced through checking whether a local copy of a required 

individually tailored translation for communications back file already exists in the further storage means before caUing 

and forth between each type of terminal and each configu- it ^^m across the network. To erisure that the duphca tion 

ration of virtual environment supported. of locally held copies of those ^files also pa ssed to the firs t 

Aparticular benefit arises when the format of data storage ^ memory means when required for renderingjoes not require 

and representation for virtual environments is at least par- unrealisUcally large amounts of available men^, the appa- 

tially standardized, allowmg for greater interchange between fatu^ mem ory manager means noTo^ggectsw^ 

systems of different manufacturers as well as a reduction in me mory miTnes^is reachmg-gnt^aTle^ls, but also de ter- 
the necessity for individually tailored translation utilities. 

With at least partial standardization, the necessary configu- byjdentification o£thge 

ration of a browser for accessing such data, whether in a whose continued usefuhiess has thereby become suspect, 

hardware or software implementation or a mixture of the As a feature of its operation, the memory management 

two, becomes simpler. means is suitably configured to maintain and periodically 

A notable example of standardization in the field of data 35 ^P^^te a table identifying, as respective entries in the table, 

defining virtual environments is the so-called Virtual Reality ^^ta files required for generation of said image. In this table 

Modeling Language (VRML) as described, for example, in ^^ta file entries, the memory management means may 

the VRML standard, version 2.0, issued as ISOAEC ^^^^^^ ^^^^ table entry, an indication of the respective 

WD14772 on Aug. 4th 1996. VRML is a file format for data files source: for data files held within one or other area 

describing interactive three-dimensional objects and worlds 40 ^^^^^^^ apparatus, this indication of the respective 

to be experienced on the Internet/World Wide Web and it is '^^ta files source may comprise a memory address for the 

generaUy analogous to the way HTML (HyperText Markup data file, wherein for data files held at remote locations 

Language) is used to describe documents for transmission accessible via said data network, the indication of the 

over the Internet. Anumber of examples of VRML browsers respective data files source may comprises a network 

are discussed in "Building VRML Worlds" by E.Titteletal, ,5 ^^^ress and such accessing information (for example full 

published by McGraw HiU 1997, ISBN 0-07-882233-5, at title, passwords etc.) as is required for acquiring that data file 

pages 26 to 31 . The funcUonalities of the different browsers, ^^^m its respective remote location, 

over and above the basic required for conformity, depend to In addition to the foregoing, the memory management 

a large extent on their target host system and the Likely uses means may also include in the table (for each entry) an 

of the same, as weU as whether they are purpose-built/ jq indication as to whether or not the respective data file has 

written or whether they are modifications of earlier utilities. been stored in the first storage means, that is to say whether 

It is an object of the present invention to provide a user it has actually been called up for use by the browser. As ^ 

operable means for browsing data defining a virtual envi- mentioned above, the memory manager not only detects, , 

ronment and rendering a view of the same, having improved when memory fullness is reaching critical levels (indicated 

efficiency in the handhng of data obtained from one or more 55 "^^^^ ^^"^^"^ memory use is in the range of 60 to 100% 

remote sources for use in the generation of representations of available storage capaaty) but also determmes which files 

of virtual environments. ^^^^ted from the further storage means to firee 

In accordance with the present invention there is provided "^^^^^^ (^^^ ^^^P^^ . ^^^^ ^f°^°^. ^"^^^^ °^ 

a data processing apparatus configured as a virtual environ- ^^^f ^^^^^.S^ "".^^u'^^^'J^u ^^J*'^^ ^ 

ment data browser, the apparatus comprising a processor 60 °^^y ^^P^^ '^^^^^^g 

coupled with at least first storage means and data network ^^^^^^ ^^^a files have been stored in the first 

interface means capable of receiving data defining a virtual storage means. 

environment and objects therein when coupled to a data BRIEF DESCRIPTION OF THE DRAWINGS 
network including a source of such data, the apparatus 

further comprising user input means and being configured to 65 Further features and advantages of the present invention 

periodically generate an image based 00 said data defining will become apparent from reading of the following descrip- 

the virtual environment and objects and from a viewpoint at tion of preferred embodiments of the invention, described by 
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way of example oaly, with reference to the accompanying 
drawings, in which: 

FIG. 1 is a block schematic diagram of a data processing 
system suitable to embody the present invention; 

FIG. 2 represents the component functions of a browser, 5 
as hosted by the system of FIG. 1, and embodying the 
invention; and 

FIG. 3 represents the interaction between the browser of 
FIG. 2 and a distributed database management system also 
hosted by the system of FIG. 1. lo 

DETAILED DESCRIPTION OF THE 
INVENTION 

FIG. 1 represents a data processing system, such as a 
personal computer, which acts as host for a software utility 
that configuxes the system as both a browser for data 
defining a virtual environment, and a distributed database 
management system for handling of obtaining the required 
data from one or several remote locations. The system 
comprises a central processing unit (CPU) 10 coupled via an 
address and data bus 12 to random-access (RAM) and 
read-only (ROM) memory devices 14, 16. The capacity of 
these memory devices may be augmented by providing the 
system with means to read from additional memory devices, 
such as a CD-ROM. ^ 

Also coupled to the CPU 10 via bus 12 are first and second 
user input devices 18, 20 which may suitably comprise a 
keyboard and a cursor control and selection device such as 
a mouse or trackball. Audio output from the system is via 
one or more speakers 22 driven by an audio processing stage 3Q 
24; in addition to providing amplification, the audio pro- 
cessing stage is preferably also configured to provide a 
signal processing capability under the control of the CPU 10 
to allow the addition of sound treatments such as echo to 
existing audio data. Video output from the system is pre- 35 
sented on display screen 26 driven by display driver stage 28 
under control of the CPU 10. 

A further source of data for the system is via online link 
to remole sites, for example via the Internet" to^which end 
the system is provided with a network interface 30 coupled 40 
to the bus 12. The precise construction of the interface is not 
an essential feature of the present invention, although it will 
be recognized that the interface configuration wlQ depend on 
the type of data network to which the system is to be 
coupled: for example, where the system is for use by a 45 
private home user, the data link is likely to be a telephone 
connection to a local service provider. In such a case, the 
interface 30 wiU suitably incorporate a modem. For other 
types of data link, such as an ISDN connection, the interface 
will be configured accordingly. 50 

Turning now to FIG. 2, the inter-relationship of a number 
of functions assembled to configure a part of the hardware 
of FIG. 1 as a browser is illustrated. The functions in the 
example illustrated arc particularly suited for browsing 
virtual environments defined in accordance with the VRML 55 
standard, version 2.0, issued as ISO/IEC WD14772 on Aug. 
4th 1996, although it will be understood that the present 
invention is not restricted by, or limited to, conformance 
with this standard. Only those components and functions of 
the browser as are required for understanding of the present so 
invention will be described in detail: a fuller description of 
this browser configuration and its operation is given in the 
commonly assigned United Kingdom patent application 
971101.9, filed May 29th 1997 and unpublished at the 
priority date of the present application. 55 

The browser is based around a scene manager 40 coupled 
with respective stores for functions 42, assets 44, and a 
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hierarchy of scene nodes 52, In terms of the hardware of 
FIG. 1, the function, asset and hierarchy stores will generally 
be held in RAM 14, although some of the assets (for 
example standardized tcxtxu:e maps) may be provided in fast 
local caches, or via offline storage such as CD-ROM. The 
browser implementation program is suitably held in ROM 
16, optionally linked to the boot-up utility of the system. 
Also coupled with the scene manager are four interfaces 
(IF.1-IR4) 46-49 and a clock 50. The first of the four 
interfaces 46 corresponds in part to interface 30 of FIG. 1 in 
that it represents the source of data received via the Internet: 
as represented by dashed line 54, the received data may be 
passed on from the interface to other (not shown) 
destinations, such as a further browser for HTML content in 
the received data. The first interface is the general arrival 
point for the data defining the virtual environment and, as 
such, it may also receive data from more local sources such 
as storage on the system RAM (14; Fig.l) or a CD-ROM. 

From the first interface, the data passes to a parsing stage 
56 which divides it into data defining or relating to assets 
(which data is then passed to store 44) and data defining or 
relating to the run-time node hierarchy (which data is then 
passed to store 52). In operation, it will generally be the case 
that only the data required (in terms of texture, co-ordinates 
etc) immediately or in the short term wiU actually be loaded 
up by the browser. 

The second interface 47 is an external API (application 
programming interface) which may suitably comprise a set 
of interfacing subroutines such as to enable multiple-user 
extensions to the system, for example to support two or more 
users having respective viewpoints within a common envi- 
ronment. 

The third interface 48 is for operational segments used to 
program behavior in a scene: these segments are referred to 
in VRML as script nodes. The script nodes contain a 
program module which, in response to a change or user 
action within a scene, effect a change somewhere else in the 
scene depending on the contents of the program module. The 
program modules may suitably contain Java® language 
segments (Java is the object-oriented platform-independent 
and general-purpose programming enviroimicnt developed 
by Sun Microsystems Inc). The third interface 48 provides 
a path to a Java interpreter which converts the Java segments 
from their platform independent form to a form recognized 
by the host system. 

The fourth interface 49 handles the passing of signals 
from (and in some instances to) the user input devices. 

The functions (ftinctional modules) held in store 42 
include an audio manager, MPEG decoder, features for node 
run-time implementations (such as interpolators), collision 
detectors, three-dimensional pickers, viewpoint control and 
routing mechanisms. 

The assets within store 44 are the basic bmlding blocks 
and operational features from which the virtual enviroimient 
is built up. These assets include three-dimensional geometry 
defining the configuration and relative location of the poly- 
gons to be assembled for the virtual environment, textures 
for mapping onto polygon surfaces during rendering, audio 
data, Java® code, user interaction data and/or MPEG data. 

The further store for run-time structures 52 contains the 
VRML scene graph together with routes to allow dynamic 
behavior. The scene graph is a hierarchical file specifying 
the connections between the various geometrical compo- 
nents making up an object within the virtual environment. 

FIG. 3 represents the interaction between the browser of 
FIG. 2 (indicated generally at 70) and a further utility 
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supported by the programmed apparatus, namely a distrib- 
uted database managemeat system 72 which handles the 
obtaining of VRML files via the network 74. Certain respec- 
tive areas of system memory 76, 78 are reserved to each of 
the utilities (for example for the browser asset store 44) and 5 
a further utility in the form of a memory management stage 
80 is provided to streamline operation of the two principle 
utiUties. In the absence of control from management utility 
80, unnecessary duplication of effort could occur, for 
example in the area of maintaining an updated local graphics lo 
database. 

In the example shown, the application has two locales A 
and B, that is to say virtual environment areas of interest that 
are effectively disparate. For simplicity of illustration, the 
only assets in these locales are assumed lo be graphical 15 
assets. The geometry of locale A is described by the file 
Awrl, and that of B by B.wrl. If the user is navigating locale 
A, then the generated view of the virtual environment is 
based on the contents of Awrl. These assets (wrl-sufi5x files) 
are permanently stored on file-server 82 and accessed via the 20 
network 74 by the distributed database management utility 
72 for downloading to the browser 70. 

With the user in locale A, the browser 70 requires Aw rl 
to be downloaded, w hich it then parses and converts into 
run-tmie data structures for efficient rendering and Simula- ^ 
tion. This requires the database manager 72 to fetch Awrl 
from the file-server 82 and then forward this to the browser 
70: for reasons of ef&ciency, the database manager 72 also 
stores a copy of A.wrl in its respective area of memory 78 
such that, for frequently required assets or files, there is a 
good chance of them abeady being held in the local memory 
of database manager 72 and thus an access call to obtain the 
data again from file-server 82 is avoided. Although this 
arrangement can reduce delays due to accessing, it is waste- 
ful of local memory and accordingly the memory manage- 
ment utility 80 identifies, among the stored data files which 
have been called up, those which have been passed to the 
browser 70 and should any shortage of free memory be 
determined, the utility 80 frees up the memory currently 
occupied by those files which have already been forwarded. ^ 

In order to assist the memory management utility 80, a 
table 84 is maintained in the system memory (as shown it 
may be within that part 78 allocated to the database manager 
72), with the table 84 containing a list of the files required 
by the browser 70 and, for each entry, an indication of the 
file source (for example full title and home file server), an 
indicator for whether or not the browser has downloaded the 
file data and stored it in its own area of memory 76, and an 
indicator (pointer) for the start of the file data within the 
database managers area of memory 78. 

Although defined principally in terms of a software 
browser implementation, the skilled reader wiU be well 
aware than many of the above-described functional features 
could equally well be implemented in hardware. 55 

From reading the present disclosure, other modifications 
will be apparent to persons skilled in the art. Such modifi- 
cations may involve other features which are already known 
in the design, manufacture and use of image processing 
and/or data network access apparatus and devices and com- 60 
ponent parts thereof and which may be used instead of or in 
addition to features already described herein. Although 
claims have been formulated in this application to particular 
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combinations of features, it shoidd be understood that the 
scope of the disclosure of the present application also 
includes any novel feature or novel combination of features 
disclosed herein either explicitly or implicitly or any gen- 
eralization thereof, whether or not it relates to the same 
invention as presendy claimed in any claim and whether or 
not it mitigates any or all of the same technical problems as 
does the present invention. The applicants hereby give 
notice that new claims may be formulated to such features 
and/or combinations of such features during the prosecution 
of the present application or of any further application 
derived therefrom. 
What is claimed is: 

1. Data processing apparatus configured as a virtual 
environment data browser, the apparatus comprising a pro- 
cessor coupled with at least first storage means and data 
network interface means capable of receiving data defining 
a virtual environment and objects therein when coupled to a 
data network including a source of such data, the apparatus 
further comprising user input means and being configured to 
periodically generate an image based on said data defining 
the virtual environment and objects and from a viewpoint at 
a location and with an orientation in said virtual environ- 
ment determined at least partially by input firom said user 
input means; characterized in that further storage means are 
provided with the apparatus further comprising memory 
management means configured to place in said further 
storage means a copy of each data file received via the 
network, to check within said further storage means for data 
files before calling for them via the network, and to deter- 
mine both required and available data storage capacity for at 
least the first and further storage means of the apparatus and, 
when the required capacity exceeds a predetermined level, to 
clear from said further storage means those data files also 
passed to the first storage means. 

2. Apparatus as claimed in claim 1, wherein said memory 
management means is configured to maintain and periodi- 
cally update a table identifying, as respective entries in the 
table, data files required for generation of said image. 

3. Apparatus as claimed in claim 2, wherein said memory 
management means maintains, for each table entry, an 
indication of the respective data files source. 

4. Apparatus as claimed in claim 3, wherein for data files 
held within memory means of said apparatus, said indication 
of the respective data files source comprises a memory 
address for said data file. 

5. Apparatus as claimed in claim 3, wherein for data files 
held at remote locations accessible via said data network, 
said indication of the respective data files source comprises 
a network address and such accessing information as is 
required for acquiring said data file from its respective 
remote location. 

6. Apparatus as claimed in claim 2, wherein said memory 
management means includes in said table for each entry an 
indication as to whether or not the respective data file has 
been stored in the first storage means. 

7. Apparatus as claimed in claim 1, wherein said prede- 
termined level is in the range of 60 to 100% of available 
storage capacity, 

8. Apparatus as claimed in claim 7, wherein said prede- 
termined level is 90% of available storage capacity. 

» * * * * 
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